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ABSTRACT 


The  goal  of  this  study  was  to  aid  designers  in  selecting 
the  best  data  input  device  for  the  design  of 
Instructor/Operator  Stations  (lOSs) .  A  literature  review  of 
touch  screen,  mouse,  and  tracJcball  technologies  is  provided. 
TOS  users  were  surveyed  to  evaluate  the  use  of  touch  screens 
with  several  military  flight  simulators.  lOS  users' 
experience  level,  frequency  of  touch  screen  interaction,  and 
familiarity  with  touch  screen,  mouse,  and  trackball  devices 
are  provided,  along  with  data  on  the  tasks  performed,  required 
accuracy,  parallax,  arm  fatigue,  and  feelings  toward  touch 
screen  use.  It  is  concluded  that,  although  touch  screens  are 
being  used  by  persons  with  too  much  experience  and  for  tasks 
reported  in  the  literature  to  be  inappropriate,  results  are 
generally  satisfactory.  However,  it  is  recommended  that  input 
devices  should  be  matched  with  the  tasks  performed. 
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I .  INTRODUCTION 


A.  BACKGROUND 

Automated  training  systems  have  become  an  integral  part  of 
the  military  as  a  result  of  demonstrated  cost  effectiveness 
and  high  quality.  It  is  anticipated  that  the  importance  of 
these  systems  will  increase  in  the  face  of  military  budget 
cutbacks  and  the  need  to  "do  more  with  less".  Consequently, 
the  Navy  continually  will  need  to  seek  improvements  in  the 
design  of  its  training  systems.  One  area  of  automated 
training  systems  in  need  of  attention  is  the 
Instructor/Operator  Station  (lOS) . 

The  lOS  consists  of  the  displays  and  controls  used  by  the 
instructor  to  interact  with  the  training  system. 

The  lOS  derives  its  name  from  the  fact  that  many  automated 
training  devices  require  an  instructor  or  operator  to  control 
the  training  session  and  impart  expertise  to  the  trainee.  An 
example  is  an  automated  flight  trainer  where  a  student  trainee 
"flies"  the  aircraft  while  an  instructor  monitors  the  training 
session . 

For  a  system  designed  with  an  lOS,  one  or  more  individuals 
perform  all  input  tasks  necessary  to  create  the  desired 
"environment"  under  which  flight  training  is  to  be  conducted. 
Tasks  such  as  aircraft  and  target  positioning,  weapons  and 
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fuel  loading,  practicing  normal  and  emergency  procedures,  and 
changing  weather  conditions  are  excunples  that  are  common  to 
many  flight  simulators.  However,  the  methods  used  for  data 
input  via  the  lOS  can  differ  significantly. 

The  Naval  Training  Systems  Center  (NTSC)  in  Orlando, 
Florida,  is  in  the  process  of  reviewing  several  modern 
automated  training  devices  in  order  to  gather  information  for 
improving  the  design  of  the  lOS  [Ref.  1] .  NTSC  has  focused 
its  attention  on  methods  by  which  instructors  can  input  data 
and  commands  to  the  system.  It  is  apparent  to  NTSC  that  an 
increasing  number  of  systems  are  employing  touch  screen 
technology  for  all  or  part  of  the  instructor' s  interface  with 
various  systems.  System  developers  at  NTSC  have  questioned 
the  input  device  selection  process  for  military  training 
devices.  [Ref.  2] 

The  lack  of  information  regarding  how  best  to  make 
selections  places  system  developers  in  a  situation  in  which 
they  must  continually  "reinvent  the  wheel."  Each  time  a  new 
training  system  is  developed,  similar  issues  are  addressed 
with  respect  to  input  device  selection.  There  exists  very 
little  data  as  to  which  input  device  is  best  suited  to  perform 
the  tasks  required  by  a  given  system. 

Although  touch  screen  implementation  may  appear  to  be  a 
logical  choice  for  user  inputs,  a  definitive  guideline  for 
selecting  input  devices  is  unavailable.  A  comprehensive 
review  of  alternative  input  techniques  is  needed  in  order  to 
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determine  which  input  device  is  best  suited  for  a  particluar 
lOS.  Operator  performance  while  using  a  mouse  or  a  trackball 
should  be  compared  with  touch  screen  performance  prior  to 
making  a  final  decision.  This  information  will  lead  to  an 
improved  design  process,  resulting  in  more  effective  training 
systems . 

B.  MILITARY  FLIGHT  SIMULATORS 

Several  Air  Force,  Navy,  and  Marine  Corps  flight 
simulators  used  for  training  are  located  at  Luke  Air  Force 
Base,  Phoenix,  Arizona  (F-15E  and  F-16C  aircraft) ,  Lemoore 
Naval  Air  Station,  California  (A-7E) ,  Marine  Corps  Air 
Station,  Yuma,  Arizona  (AV-8B) ,  and  Marine  Corps  Air  Station, 
El  Toro,  California  (F/A-18) .  These  sites  are  representative 
of  all  simulators  located  in  the  Western  United  States  which 
use  touch  screens  as  input  devices.  All  of  these  trainers  are 
operated  from  a  console  where  the  instructor  and  operator 
perform  the  various  data  entry  tasks  needed  to  conduct  a 
training  flight  in  the  simulator. 

The  F-16C  weapon  systems  trainer  (WST)  IDS  uses  an 
oversized  optical  (infrared)  touch  screen  monitor  to  perform 
data  input.  All  data  entry  is  done  through  one  of  two 
identical  monitors.  Each  monitor  sits  on  a  desk,  surrounded 
by  a  small  console  with  dummy  aircraft  gauges  and  a  monitor 
which  allows  the  instructor  to  call  up  any  one  of  the  pilot's 
head-up  display  screens.  The  console  uses  only  two  screens. 
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All  console  components  are  visible  and  easily  reachable  from 
a  sitting  position. 

The  F-15E  WST  lOS  consists  of  a  large  console  (Figure  1) 
which  wraps  approximately  180  degrees  around  the  instructor 
and  the  operator.  Displays  are  located  around  the  console 
stretching  from  desktop  level  to  roughly  6  feet  above  the 
desk.  A  total  of  17  screens  are  located  in  this  lOS.  Two  of 
these  screens  are  resistive  membrane  touch  screens  used  for 
high-level  menu  selection.  While  there  is  some  redundancy  of 
screens,  most  of  them  display  unique  information. 


Figure  1.  F-15E  Simulator  Instructor /Operator  Station 

The  A-7E  WST  lOS  consists  of  one  panel  containing  one 
monitor  screen,  a  combination  of  dedicated  keys,  and  a 
traditional  keyboard  for  data  input.  Three  redundant 
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capacitive  touch  screens  are  located  beside  the  display  and 
control  panel.  These  screens  were  added  to  the  original  lOS 
to  perform  weapons  loading  tasks  through  menu  selections. 

The  AV-8B  WST  lOS  (Figure  2)  is  designed  in  an  "L"  shape 
with  instructor  input  terminals  on  the  right  and  general 
display  monitors  directly  in  front  of  the  instructor.  System 
setup  is  accomplished  using  dedicated  function  keys.  One 
infrared  touch  screen  is  located  on  the  instructor's  right  and 
is  used  for  system  control  via  menu  selection. 


FPOMT  VIEW 


c  c 

»0TA.  CD  75*  CCW 


Figure  2.  AV-8B  Simulator  Instructor/Operator  Station 

The  F/A-18  WST  103  is  also  designed  in  an  "L"  shape.  Two 
capacitance-type  touch  screens  are  located  on  either  end  of 
the  control  panel  for  system  control  via  menu  selection. 
Dedicated  keys  located  adjacent  to  the  touch  screens  can 
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perform  the  same  functions  and  may  be  used  instead  of  the 
touch  screens.  The  center  area  of  the  control  panel  contains 
several  multi-purpose  monitors  for  training  session  overview. 

C .  REIATEO  STUDIES 

An  extensive  literature  review  on  alternative  input 
methodology  provided  mixed  results  on  the  rel.itive  value  of 
the  mouse,  trackball,  and  touch  screen.  Each  device  is 
designed  to  optimize  performance  of  a  specific  type  of  task  or 
group  of  tasks.  For  instance,  as  Pickering  [Ref.  3:  pp.  249- 
269]  notes,  no  single  type  of  touch  screen  technology  is  able 
to  perform  all  the  different  input  tasks  well.  "All 
commercially  available  techniques  have  concentrated  on  one 
particular  sensing  method,  for  market  reasons,  and  have 
optimized  that  method  to  meet  the  detection  requirements." 

Similar  design  limitations  affect  the  mouse  and  trackball. 
Reports  and  articles  on  the  subject  of  alternative  input 
devices  suggest  that  market  forces  (which  equate  to  customer 
preference)  drive  the  development  of  the  devices. 
Accordingly,  each  of  the  devices  reflects  a  particular  slice 
of  the  market  and  may  or  may  not  be  appropriate  for  any  given 
application , 

For  example.  Karat,  [Ref.  4:pp.  73-78]  suggests  that  the 
actual  selection  of  an  input  device  for  a  particular  system  is 
technology  dependent.  Card  [Ref.  4:p.  76]  found  the  mouse  to 
be  the  best  device  for  target  selection  while  users  performed 
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poorly  using  a  mouse  in  an  entirely  menu-driven  system.  Touch 
screen  was  found  to  be  the  preferred  device  for  the  all  menu- 
driven  systems . 

These  results  do  not  translate  easily  into  information 
applicable  to  a  given  user  with  a  given  set  of  tasks  to 
perform.  Eckhouse  [Ref.  5:p.  128]  further  clouds  the  issue 
when  he  concludes  that  the  mouse  is  quite  natural  for  screen- 
oriented  applications  and  that  the  touch  screen  is  most  useful 
for  high-end  systems  (commercial  and  military)  and  for  use  on 
information  kiosks.  Furthermore,  Eckhouse  notes  that  the 
mouse  and  trackball  have  considerably  better  resolution  than 
the  touch  screen  and  that  the  touch  screen  has  no  equivalent 
to  the  pushbuttons  found  on  the  mouse  and  trackball. 
Rosenthal  [Ref.  6:p.  90]  claims  that  most  experts  believe 
touch  screens  are  best  suited  for  specialized  operations  such 
as  factory  control  and  telephone  operator  assistance. 

While  opinions  on  the  relative  value  of  the  three  kinds  of 
devices  is  mixed,  some  degree  of  consensus  exists  concerning 
which  are  best  suited  for  general  input  activities.  This 
consensus  provides  simple  guidelines  to  assist  designers  and 
developers  in  specifying  input  requirements  for  a  given 
system. 

Six  types  of  abstract  input  tasks  are  proposed  by  Foley 
[Ref.  7:pp.  13-48]  to  allow  for  a  general  ranking  of  input 
devices.  These  tasks  are  termed  select,  position,  path,  text 
entry,  quantify,  and  orient.  Quantify  and  orient  tasks  do 
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not  apply  to  this  comparison  of  touch  screen,  mouse,  and 
trackball  devices.  Text  entry  is  the  process  of  a  user 
specifying  a  sequence  of  symbols,  such  as  composing  a 
filename.  This  task  is  applicable  to  the  comparison  of  the 
three  input  devices,  but  to  a  lesser  extent  than  select, 
position,  and  path,  due  to  the  nature  of  the  devices  at  hand. 
Selection  is  the  act  of  choosing  an  item  from  a  set  of 
alternatives.  Menu  selection  is  a  common  exeunple  of  this  type 
of  task.  Positioning  requires  the  user  to  specify  a  point  in 
a  space  defined  by  a  particular  application.  An  example  of 
this  task  is  placement  of  the  cursor  on  a  specific  spot  on  an 
application  screen.  The  path  input  task  is  performed  when  the 
user  specifies  a  direction  in  a  space  defined  by  a  particular 
application.  The  path  input  task  permits  curves  to.  be  drawn 
by  the  user.  This  is  basically  the  same  task  as  positioning, 
however  direction  is  expressed  rather  than  a  single  point. 
Table  1  illustrates  generally-accepted  preferences  for  the 
three  devices,  for  use  in  performing  selection,  positioning, 
path,  and  text  entry  tasks. 
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TABLE  1.  BEST  INPUT  DEVICES  FOR  THE  PERFORMANCE  OF  FOUR 

GENERIC  TASKS.  Input  devices  are  listed  in  order 
of  preference.  [Ref.  8:pp.  108-109] 


Task 

Preferred  Input  Device 

Selection 

Touch  Screen,  Mouse,  Trackball 

Positioning 

Mouse/Trackball,  Touch  Screen 

Path 

Mouse,  Trackball,  Touch  Screen 

Text  Entry 

Mouse,  Touch  Screen,  Trackball 

D.  GOAL  AND  OBJECTIVES 

The  goal  of  this  study  is  to  provide  NTSC  with  information 
that  may  be  used  in  deciding  what  type  of  input  device  is  best 
suited  for  particular  input  tasks  related  to  the  lOS.  Several 
objectives  have  been  met  to  achieve  this  goal. 

First,  a  comprehensive  literature  review  was  completed  in 
order  to  determine  a  consenus  as  to  what  type  of  input  devices 
are  best  suited  for  abstract  input  tasks  (Table  1) .  Second, 
a  survey  was  designed  and  administered  to  instructors  and 
operators  of  several  automated  training  systems .  The  survey 
has  provided  a  means  for  comparing  the  types  of  input  tasks 
currently  carried  out  using  lOS  touch  screens  with  the 
generally-accepted  preferences  listed  in  Table  1.  Finally, 
conclusions  and  recommendations  concerning  the  relationship 
between  survey  results  and  literature  consenus  are  made  based 
on  the  collected  data. 
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E .  SCOPE 


This  study  reviews  user  performance  and  preferences 
related  only  to  lOS  computer  inputs  of  three  hardware  devices : 
a  mouse,  trackball,  and  touch  screen.  Emphasis  is  on  the  use 
of  these  devices  for  automated  training  systems.  It  is  not 
the  intent  of  this  study  to  determine  the  overall  superiority 
of  one  input  device  over  any  other. 

Those  systems  not  designed  with  an  lOS  were  not  considered 
for  this  study  due  to  their  distributed,  and  therefore 
inaccessible,  nature.  Moreover,  there  are  more  similarities 
among  instructors  and  operators  who  are  trained  to  work  with 
similar  systems  (such  as  flight  simulators)  than  among  those 
trained  to  use  different  systems.  Finally,  NTSC  has  a  high 
degree  of  interest  in  the  lOS,  which  is  perhaps  best 
exemplified  in  military  flight  simulators. 
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II.  TOUCH  SCREICN,  MOUSE,  AMD  TRACKBALL  TECHNOLOGIES 


A.  BACKGROUND 

The  human- computer  interface  in  the  past  has  relied 
primarily  on  the  keyboard  as  the  means  by  which  the  user 
communicates  with  the  computer.  While  the  keyboard  is  still 
the  predominant  input  device  for  commands  and  text, 
developments  in  software  and  hardware  have  led  to  greater 
system  capabilities  requiring  the  ability  to  "point"  to  a 
given  target  or  selection  on  the  screen.  Programs  requiring 
these  capabilities  include  graphics,  tracking,  and  computer- 
aided  design.  Pointing  can  be  accomplished  directly  on-screen 
or  with  the  use  of  off-screen  control  devices.  Touch  screen 
technology  uses  on-screen  direct  pointing,  while  the  mouse  and 
trackball  are  examples  of  off-screen  indirect  pointing 
devices . 

There  has  been  great  emphasis  on  creating  an  easier-to-use 
environment  to  help  bridge  the  gap  between  the  rapidly 
expanding  technologies  behind  new  computer  systems  and  naive 
users  who  must  learn  increasingly  complex  tasks  in  order  to 
interface  with  these  new  computer  systems.  Manufacturers  have 
moved  toward  simpler  communication  layouts,  on-screen  pointing 
capability,  graphical  interfaces,  and  menu-driven  selection 
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schemes.  These  trends  have,  in  turn,  led  to  the  development 
of  improved  alternative  input  devices  from  which  to  choose. 

A  problem  arises  when  considering  the  various  options  for 
alternative  means  of  input.  Which  input  device  or  devices 
should  be  used  with  a  particular  system?  Numerous  studies 
have  examined  this  issue.  However,  as  discussed  in  Chapter  I, 
the  results  of  these  studies  are  not  widely  applicable.  An 
appropriate  input  device  for  one  system  may  or  may  not  be 
desirable,  or  even  feasible,  for  another  system.  Reasons  for 
the  lack  of  widely  applicable  data  derived  from  these  studies 
includes  the  use  of  specific,  limited  subject  groups  using 
specific  software  on  specific  hardware.  Accordingly,  the 
results  apply  only  to  the  specific  situations  studied. 

Since  specific  findings  cannot  reliad^ly  be  applied  to 
other  situations,  it  is  necessary  to  make  use  of  general 
guidelines  for  input  device  selection  rather  than  using 
formulas  or  recipe-type  instructions.  The  prospective  buyer 
of  a  new  system  faces  a  choice  between  conducting  extensive 
studies  independently  or  using  generally-applicable  guidelines 
to  aid  in  the  process  of  selecting  input  devices. 

The  touch  screen,  mouse,  and  trackball  have  all  evolved  in 
an  attempt  to  keep  pace  with  the  ever-increasing  demand  for  a 
satisfactory  user-computer  interface.  Each  device  is 
different  from  the  others,  and  models  may  also  differ  within 
a  given  device  family.  The  following  sections  provide  data  on 
the  current  status  of  these  three  types  of  input  devices. 
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B.  TOUCH  SCREEN  TECHNOLOGY 

Touch  screens  are  meant  to  be  easily  operated  by  users 
without  regard  for  each  one's  level  of  computer  literacy. 
Touch  screen  operation  is  described  by  Kalb  [Ref.  9:p.  52]  as 
follows : 

Users  input  information  into  the  computer  merely  by 
touching  the  portion  of  the  screen  representing  the 
desired  function.  At  the  point  of  touch,  the  screen's 
controller  detects  a  change  in  state,  determines  the  X-Y 
coordinates,  and  sends  this  information  to  the  processor 
for  interpretation. 

Touch  screen  technology  makes  use  of  several 
implementation  schemes,  each  based  on  a  different  method  by 
which  the  computer  system  senses  the  user' s  touch  on  the 
screen.  System  developers  must  consider  each  available  type 
of  touch  screen  implementation  and  its  advantages  and 
disadvantages,  in  addition  to  other  design  options.  Four 
touch  screen  sensing  methods  currently  in  wide  use  are: 
resistive  membrane,  capacitance  sensing,  acoustic  sensing,  and 
optical  sensing, 

1 .  Resistive  Membrane  Sensing 

Resistive  membrane  technology  (Figure  3)  employs  two 
transparent  sheets  (membranes)  with  an  electrode  grid 
sandwiched  between  them.  The  combined  sheets  form  an  overlay 
which  is  applied  to  the  face  of  a  monitor.  When  the  overlay 
is  touched,  the  membranes  come  into  contact  with  one  another 
causing  the  electrodes  to  complete  a  circuit.  The  location  of 
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the  closed  contact  represents  a  location  on  the  face  of  the 
screen.  [Ref.  12:p.  135] 


Piostic  cover  sheet 

With  troftsporeoij  conductive 

cooling  on  inside 


t 


Uniform  resistive 
tronsporen!  cooling 


Figure  3.  Resistive  Membrane  Screen  [Ref.  3:p.  257] 

This  implementation  offers  the  advantage  of  relatively 
high  accuracy  since  firm  pressure  is  required  to  produce  a 
"hit"  and  because  the  area  of  contact  is  averaged  to  help 
pinpoint  screen  locations.  Disadvantages  of  the  resistive 
membrane  implementation  are  that  the  membrane  overlay  is 
difficult  to  secure  properly  to  the  monitor  screen  and  that 
the  membrane  sheets  tend  to  be  frail.  Damage  from  scratches, 
punctures,  coffee  spills,  and  the  like  are  hazardous  to  this 
type  of  touch  screen.  As  a  result,  the  resistive  membrane 
touch  screen  is  generally  not  recommended  for  public  or 
industrial  applications.  [Ref.  11 :p.  140] 
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2 .  Capacitzmce  Sensing 

Capacitance  touch  screens  (Figure  4)  use  a  thin 
metallic  conductive  coating  on  the  outside  of  the  screen  to 
sense  a  touch.  This  type  of  surface  has  the  advantages  of 
relative  durability  and  optical  transparency,  compared  to 
other  touch  screen  implementations.  [Ref.  11 :p.  141] 


Figure  4.  Capacitance  Sensing  Screen  [Ref.  11 :p.  142] 

One  disadvantage  of  this  technique  is  that  a 
conductive  stylus  (such  as  the  human  finger)  is  recfuired;  the 
touch  of  an  ordinary  pencil  or  a  glove  is  not  recognized.  A 
further  disadvantage  of  this  design  is  that  it  needs  to  be 
adjusted  for  changes  in  ambient  conditions  such  as  temperature 
and  humidity.  [Ref.  11 :p.  141] 
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3 .  Acoustic  Sensing 

Acoustic  sensing  touch  screen  (Figure  5)  technology 
employs  a  series  of  piezo-electric  transducers  placed  around 
the  perimeter  of  a  screen  overlay  to  create  acoustic  surface 
waves  along  the  X  and  Y  axes  of  the  screen.  A  touch  is  sensed 
by  locating  the  point  at  which  the  waves  are  interrupted  by 
the  stylus  or  finger.  [Ref.  ll:p.  141] 


Figure  5.  Acoustic  Sensing  Screen  [Ref.  ll:p.  143] 

An  advantage  of  this  implementation  is  that  it  may  be  used 
for  sophisticated  applications  because  specific  touch  zones 
are  programmable.  However,  this  ability  is  limited  in 
practical  terms  to  about  1/2  inch  of  spacing  between  contact 
points.  Higher  resolution  is  achieved  by  placing  the 
transducers  closer  together,  which  increases  the  sensitivity 
to  particles  of  dust  and  dirt  and  often  requires  the  use  of 
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trained  operators  in  order  to  keep  the  screen  clean.  [Ref. 
ll:p.  141] 

4 .  Optical  Sensing 

Optical  touch  screens  (Figure  6)  use  rows  of  light- 
emitting  diodes  (LEDs)  around  the  periphery  of  the  screen, 
creating  a  grid  of  infrared  light.  These  are  often  referred 
to  as  infrared  or  IR  touch  screens.  One  advantage  of  this 
type  of  screen  is  that  relatively  high  resolution  is  possible, 
in  comparison  to  other  touch  sensing  designs.  In  addition, 
the  operator  can  define  the  size  and  shape  of  touch-active 
areas  (from  the  entire  screen  wO  as  small  as  1/20  inch) ,  the 
screens  are  reliable  in  public  and  industrial  environments, 
and  there  is  no  overlay  to  contend  with.  [Ref.  11 :p.  142] 

As  is  the  case  with  all  other  touch  screen 
implementations,  optical  screens  are  not  without 
disadvantages.  The  greatest  problem  is  with  parallax,  caused 
by  straight  beams  of  light  emanating  from  the  peripheral  LEDs 
across  a  curved  screen  surface.  This  phenomenon  causes  the 
becim  to  be  close  to  the  screen  in  the  center,  but  farther  away 
at  the  edges,  resulting  in  decreased  accuracy  when  working 
near  the  edges  of  the  screen.  [Ref.  ll;pp.  142] 
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E'x9uir«  6.  Optical  (IH)  Sensing  Screen  [Ref.  11  :p.  144] 

5.  Comparison  of  Sensing  Methods 

Table  2  lists  several  attributes  (advantageous  and 
disadvantageous)  of  each  of  the  four  touch  screen  sensing 
methods:  resistive  membrane,  capacitive,  acoustic,  and 

optical.  Each  of  the  four  touch  screen  technologies  is 
addressed  according  to  the  attributes  listed.  Information 
noted  here  provides  a  starting  point  from  which  a  system 
developer  can  gather  additional  data  about  the  various 
techniques . 

TABLE  2 .  COMPARISON  OF  TOUCH  SCREEN  SENSING  METHODS . 

[Ref.  12:p.  135] 


Touch  Sensing  Method 

IliiiBaffi&Bi 

Capacitive 

Acoustic 

Pixel 
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Inadvertent 

Activation 

Less 
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Sensitive 
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Software 

Configurable 

Yes 

Ho 

Yes 

Yes 

Touch  With 

Anything 

Finger  only 

Anything 

Mis¬ 

alignment 

Temperature, 

Humidity 

Parallax 
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Table  3  illustrates  which  specific  touch  screen 
sensing  methods  are  recommended  to  perform  the  abstract  input 
tasks  described  in  Table  1.  Sensing  methods  are  listed  in 
order  of  cdsility  to  perform  the  tasks.  The  absence  of  a 
sensing  method  from  the  list  indicates  that  it  is  not 
recommended  for  the  given  task.  As  may  be  observed,  no  single 
touch  screen  sensing  implementation  can  perform  all  of  these 
input  tasks  adequately,  adding  to  the  complexity  of  selecting 
among  alternative  input  devices. 

TABLE  3.  USE  OF  TOUCH  SCREEN  SENSING  METHODS  FOR  PERFORMING 
GENERAL  INPUT  TASKS.  [Ref.  3:p.  267] 


Task 

Best  Sensing  Method 

Selection 

Resistive,  Acoustic, 
Capacitive,  Optical 

Positioning 

Optical,  Capacitive, 
Resistive 

Path 

Optical,  Resistive 

Text  Entry 

Resistive,  Acoustic, 
Capacitive 

6 .  Touch  Screen  Advantages  and  Disadvantages 

Overall,  while  individual  touch  screen  implementations 
differ,  there  is  agreement  as  to  the  advantages, 
disadvantages,  and  best  uses  for  touch  screens  in  a  general 
sense.  The  advantages  of  a  touch  screen  include  ease  of  use, 
minimum  space  requirements  (since  it  is  an  on-screen  input 
de'^’ice)  ,  and  general  suitability  for  menu-driven  systems. 
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One  disadvantage  of  touch  screens  is  that  accuracy  is 
limited  by  the  size  of  the  finger  or  stylus  being  used  to 
point  and  touch,  making  them  incompatible  with  systems 
requiring  highly  accurate  pointing  and  with  screens  that  are 
crowded  with  functions.  Another  disadvantage  is  that  they 
are  not  generally  offered  as  standard  equipment  by  many  large 
companies,  leading  to  reluctance  by  software  manufacturers  to 
invest  in  compatible  software  development.  [Ref.  9:p.  53] 

Still  another  disadvantage  of  touch  screens  is  arm 
fatigue.  While  the  simplicity  of  raising  one's  arm  to  touch 
the  screen  directly  is  seen  as  an  advantage  for  these  systems, 
doing  so  for  long  periods  of  time  can  become  tiring  and 
uncomfortable  for  the  user,  [Ref.  13:p.  40] 

7 .  Best  Uses  for  Touch  Screens 

The  generally-acc-^pted  best  uses  for  touch  screens 
capitalize  on  their  ?dvantages.  Alper  [Ref.  14 :p.  38]  views 
the  optima?,  application  of  touch  screens  as  being  in 
environments  where  computer  literacy  is  low  and  rapid 
interaction  with  the  system  is  required.  Rosenthal  [Ref.  6:p. 
90]  claims  that  "most  experts  still  see  this  technology  as 
best  suited  for  specialized  applications  such  as  factory 
control  or  operator  assistance."  Guterman  [Ref.  15 :p.  13] 
finds  viability  for  specialized  touch  screen  applications  in 
industrial  process  control  and  process  automation.  Ease  of 
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industrial  process  control  and  process  automation.  Ease  of 
use  and  minimum  space  requirements  are  often  high  priorities 
in  these  environments. 

Eckhouse  [Ref.  5:p.  128]  proposes  that  touch  screens 
are  best  suited  for  high-end  commercial  and  military  systems 
and  for  use  on  information  kiosks.  Ease  of  use  for 
inexperienced  users  is  often  viewed  as  a  top  priority  of  such 
systems.  Karat  [Ref.  4;p.  73]  found  the  touch  screen  to  be 
the  single  most  preferred  device  for  menu-driven  systems, 
because  they  take  advantage  of  all  of  the  best  features  of 
touch  screens. 

C .  MOUSE  TECHNOLOGY 

The  mouse  (Figure  7)  moves  along  a  desktop  or  other 
surface  and  sends  positioning  signals  (relative  to  the  screen) 
to  the  processor.  Mice  can  be  either  mechanical  or  optical. 
Both  types  are  roughly  the  size  of  a  deck  of  playing  cards  and 
each  has  a  wire  that  connects  it  to  the  processing  unit. 


Figure  7.  Mouse  (Ref.  16:p.  214] 


Perhaps  the  most  common  type  of  mouse  is  the  mechanical 
mouse  which  uses  potentiometers  to  sense  the  movement  of  a 
ball  located  underneath  the  unit.  The  optical  mouse  operates 
similarly;  however,  optical  photosensors  are  located  beneath 
the  unit  and  "see"  the  relative  movement  over  a  surface  rather 
than  "feel"  movement  as  the  mechanical  mouse  does.  Both  types 
of  mice  translate  relative  movement  of  the  device  into 
electrical  signals  for  interpretation  and  both  function  in 
essentially  the  same  manner.  [Ref.  17 :p.  228] 

1 .  Mouse  Advantages  and  Disadvantages 

Brown  [Ref.  12 :p.  139]  cites  several  advantages  of  the 

mouse ; 


A  mouse  provides  accurate  fine  resolution  cursor 
positioning  and  quick  movement  across  long  screen 
distances.  It  also  minimizes  arm  fatigue  because  it  allows 
the  desktop  to  support  the  weight  of  the  user's  arm. 
Furthermore,  the  mouse  may  have  one  or  more  buttons  on  top 
of  the  unit  for  acting  upon  an  object  that  has  been 
pointed  to  on  the  screen.  The  mouse  is  quite  compatible 
with  visual  interfaces  and  graphical  manipulation. 


Most  mice  have  two  or  three  buttons  that  allow  for 
option  selection  as  well  as  other  operations.  For  example, 
the  mouse  can  be  used  to  relocate  an  object  on  the  screen  by 
placing  the  cursor  at  that  location  ("pointing  to  it") , 
pressing  a  button  to  "capture"  the  object,  "dragging"  the 
object  to  the  new  location,  and  releasing  the  button  to 
"release"  the  object.  This  design  characteristic  makes  the 
mouse  excellent  for  positioning  tasks  and  highly  compatible 
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with  graphics-oriented  applications.  Rosch  [Ref.  17 :p.  228] 
describes  other  mouse  advantages,  plus  one  disadvantage: 


Mice  are  inexpensive  and  familiar  to  most  PC  users.  They 
are  the  most  widely  supported  input  device  in  terms  of 
both  hardware  and  software.  Another  point  is  that  the 
higher  the  resolution,  the  faster  the  scroll,  which  makes 
pinpoint  operations  difficult. 

The  fact  that  the  mouse  is  an  off-screen  indirect 
pointing  device  can  affect  a  decision  about  its  best  use 
because  of  the  requirement  for  desktop  operating  space.  About 
1  square  foot  of  desktop  space  is  required  to  operate  a  mouse 
[Ref.  12:p.  140].  The  trackball,  which  is  stationary, 
requires  little  desktop  space  and  the  touch  screen  requires 
none.  As  a  result,  space-critical  applications  may  not  be 
able  to  support  mouse  operations. 

Another  disadvantage  is  that  the  mouse  reqpaires  better 
hand-eye  coordination  than  a  touch  screen.  With  respect  to 
menu  selection,  Karat  [Ref.  4:p.  87]  claims,  "Touch  selection 
is  a  highly  automated  skill  for  most  humans,  while  other 
techniques  are  less  well  learned." 

Mouse  input  requires  an  intermediate  step  between 
making  a  choice  and  indicating  a  choice.  That  is,  the  user 
must  recall  how  to  indicate  the  desired  choice  to  the  system. 
Direct  pointing,  as  in  touch  screen  operation,  does  not 
require  this  step.  Karat  [Ref.  4]  also  indicates  that  this 
intermediate  step  becomes  more  well  learned  over  time,  but 
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that  experience  will  not  overcome  the  advantage  given  to 
direct  pointing. 

2 .  Best  Uses  for  the  Mouse 

The  mouse  is  considered  best  suited  for  highly 
interactive  graphical  interfaces  that  require  accurate 
pointing  [Ref.  12:p.  139].  Such  applications  are  more  complex 
than  simple  selection  of  menu  items.  Positioning  of  an  object 
on  the  screen  or  dragging  an  object  from  one  screen  location 
to  another  are  examples  of  tasks  which  are  performed  easily 
using  a  mouse.  The  path  task,  defined  in  Chapter  I,  is  also 
well  suited  for  mouse  operations. 

D .  TRACKBALL  TECHNOLOGY 

The  trackball  (Figure  8)  is  a  ball  about  2  to  5  inches  in 
diameter  that  can  be  rotated  within  a  fixed  housing  to  move  a 
cursor  or  other  on-screen  object  [Ref.  12:p.  150], 

"The  trackball  is  basically  a  mouse  on  its  back."  [Ref.  18  :p. 
21]  Operation  of  the  trackball  requires  that  the  ball  be 
rolled  by  hand,  as  the  housing  remains  stationary.  This 
highlights  the  most  fundamental  difference  between  the  mouse 
and  the  trackball.  The  mouse  requires  the  operator  to  move 
the  entire  mouse  unit  around  on  a  desktop  to  indicate  relative 
object  movement  on  a  screen.  The  trackball  operator  simply 
rolls  the  ball  while  the  unit  remains  stationary,  eliminating 
the  need  for  repositioning.  Rosch  [Ref.  17 :p.  229]  describes 
the  trackball  as  looking  like  a  "cue  ball  set  into  a  base." 
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Like  the  mouse,  the  trackball  provides  off-screen  indirect 
cursor  manipulation  relative  to  the  movement  of  the  ball.  The 
trackball  may  be  a  separate  unit  with  a  wire  connecting  it  to 
the  processor,  or  it  may  be  built  directly  into  a  keyboard  or 
an  operator's  console. 


Figure  0.  Trackball  [Ref.  16:p.  213] 

1 .  Trackball  Advantages  and  Disadvantages 

For  the  most  part,  the  trackball  and  mouse  provide 
similar  capabilities  for  information  input.  This  is  primarily 
due  to  their  similar  designs  and  functions.  However, 
trackballs  are  considered  individually  because  they  hold 
certain  advantages  over  the  mouse. 

Perhaps  the  greatest  advantage  of  the  trackball  over 
all  other  alternative  input  devices  is  its  minimal  space 
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requirement.  Obviously,  on  a  system  where  space  is  critical, 
the  trackball  receives  higher  consideration  than  for  a  system 
where  there  is  no  space  restriction. 


Another  trackball  advantage  is  its  ability  to  perform 
highly  accurate  operations.  According  to  Brown  [Ref.  12 :p. 
151],  the  trackball  is  effective  for  fine  cursor  control 
tasks,  such  as  target  tracking. 

Systems  that  require  physical  integrity,  such  as 
certain  military  systems,  may  also  find  the  ability  to  mount 
the  trackball  in  a  keyboard  or  console  to  be  an  advantage  or 
even  a  requirement,  especially  for  mobile  or  combat  systems. 
Still  another  advantage  of  the  trackball  is  identified  by  Kalb 
[Ref.  9;p.  54],  who  claims  that  the  trackball  can  be  a  good 
pointing  device  for  the  physically  challenged  who  may  not  have 
the  dexterity  to  operate  other  devices. 

One  disadvantage  of  the  trackball  is  that  it  is  harder 
to  control  than  the  mouse  while  performing  essentially  similar 
tasks.  "The  general  design  of  most  trackballs  does  not  use 
the  design  of  the  hand  efficiently."  [Ref.  19:p.  217] 

Other  disadvantages  are  that  trackballs  tend  to  cost 
more  than  mice,  and  are  generally  less  familiar  to  most  users. 
For  the  generic  input  tasks  discussed  in  Chapter  I,  the  mouse 
has  been  found  to  be  generally  preferable  to  the  trackball 
[Ref.  8:p.  108]. 
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2 .  Best  Uses  for  Trackball 


Due  to  its  stationary  nature,  a  trackball  is  often 
preferred  for  use  on  systems  with  restricted  desktop  space  and 
for  systems  that  may  be  operated  by  a  physically  handicapped 
person.  Because  of  their  ability  to  provide  fine  cursor 
control,  trackballs  are  commonly  used  on  systems  that  require 
object  or  target  tracking  such  as  air  radar  tracking  systems. 

E.  SUMMARY  OF  ALTERHATIVE  INPUT  TECHNOLOGIES 

Each  type  of  input  device  discussed  here  has  unique 
advantages  and  disadvantages.  Although  selection  of  the 
proper  input  device  can  be  crucial  to  system  effectiveness, 
there  is  no  recipe  for  selecting  one  of  these  devices  in  favor 
of  another  for  a  given  system.  Only  specific  system 
requirements  such  as  information  display,  data  entry 
requirements,  physical  size,  and  user  capabilities  ultimately 
can  define  the  best  input  device  for  that  system. 

System  developers  can  properly  choose  cunong  input  device 
alternatives  by  becoming  familiar  with  the  general  limitations 
and  capa±)ilities  of  each.  While  each  system  will  undoubtedly 
have  unique  requirements,  knowledge  of  the  availiable  devices 
will  provide  for  wiser  and  more  informed  decisions.  Table  4 
provides  a  summary  of  characteristics  for  touch  screen,  mouse, 
and  trackball. 
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TABLE  4 


SUMMARY  OF  TOUCH  SCREEN,  MOUSE,  AND  TRACKBALL 
CHARACTERISTICS.  [Ref.  12:pp.  154,  155] 


Device 

Touch  Screen  Mouse  Trackball 

Uses 

Select 

Point,  Select, 
Draw,  Drag, 

Move  cursor 

Track,  Select, 

Move  cursor 

Disadvantages 

Accidental 

activation. 

Arm  fatigue 

Needs  desk 
space.  Has  a 
trailing  cord 

Mouse  faster  for 
selecting  text 

Recommended 

For 

Infrequent 

use, 

Coarse 

pointing 

Highly 

interactive 

graphical 

interfaces 

Precise 
point ing 

Not 

Recommended 

For 

Continuous 

use, 

Moderately 

precise 

pointing 

Frequent 

mouse-to- 

keyboard 

changes 

Frequent 

trackball-to- 

keyboard 

changes 

Comments 

Provide  an 
arm  rest 

Mouse  buttons 
add  functional 
capability 

Provide  for 
left-handed 
users 
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III.  SURVEY  OF  TOUCH  SCREEN  lOS  USERS 


A.  GOAL  OF  THE  SURVEY 

The  goal  of  this  study  is  to  provide  NTSC  with  data  that 
can  be  used  to  determine  the  best  type  of  input  device  for 
specific  lOS-related  input  tasks.  As  reported  in  Chapter  II, 
information  was  collected  from  the  literature  on  the  various 
kinds  of  input  devices  and  on  proposed  best  uses  for  each.  In 
addition,  instructors  and  operators  at  the  flight  simulator 
sites  listed  in  Chapter  I  were  queried  to  determine  their 
opinions  concerning  touch  screen  systems.  These  five 
simulators  were  selected  because  each  incorporates  a  touch 
screen  as  part  of  the  data  entry  and/or  control  systems. 

A  questionnaire  was  used  to  survey  the  instructors  and 
operators.  It  consisted  of  13  questions,  including  simple 
"yes/no"  questions,  rating  scales,  and  open-ended  questions. 
Background  questions  included  the  type  of  training  system  used 
by  the  respondent,  the  respondent's  experience  level  with 
respect  to  that  system,  and  the  respondent's  feuniliarity  with 
various  input  devices.  The  remainder  of  the  survey  solicited 
opinions  on  various  issues  surrounding  the  employment  of  touch 
screen  systems  for  data  input  for  the  respondents'  specific 
systems . 


B .  QUESTIONNAIRE  DEVELOPMENT 

The  questionnaire  used  in  this  study  (Appendix  A)  was 
influenced  by  the  U.S.  Army's  Questionnaire  Construction 
Manual  [Ref.  20:pp.  1-219].  Further,  because  there  was  no 
known  study  regarding  the  use  of  touch  screens  on  military 
flight  simulators,  the  questionnaire  was  designed  to  obtain  a 
broad  sweep  of  information.  Therefore,  the  questionnaire 
solicicted  descriptive  information  about  the  users  as  well  as 
their  opinions  on  the  use  of  touch  screen  with  their 
individual  systems . 

Topics  covered  by  the  questionnaire  were  defined  based  on 
issues  identified  through  literature  review,  and  the 
application  of  -  ..se  issues  to  military  flight  simulators. 
The  Questionn-.xre  Construction  Manual  [Ref.  20]  provided 
several  possible  formats  for  the  questions.  No  single  format 
was  chosen,  but  rather  several  types  were  used,  as  appropriate 
for  the  variety  of  information  solicited. 

For  questionnaires  administered  through  the  mail,  a  cover 
sheet  was  developed  to  explain  the  nature  and  purpose  of  the 
study.  The  first  portion  of  the  questionnaire  solicited 
descriptive  information  about  the  participants.  Recognizing 
that  various  touch  screen  implementations  were  being  used 
throughout  the  Navy,  Air  Force,  and  Marine  Corps,  participants 
were  asked  to  identify  the  simulator  type  they  were  familiar 
with. 
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The  level  of  experience  of  the  instructors  and  operators 
was  requested  in  order  to  compare  survey  results  with  findings 
represented  in  the  literature.  The  frequency  with  which  the 
instructors  and  operators  interact  with  their  systems  was 
determined  next.  This  question  listed  four  categories, 
ranging  from  "less  than  once  per  month"  to  "daily." 
Respondents  were  asked  to  circle  the  appropriate  choice.  This 
type  of  format  was  chosen  for  ease  of  analysis.  The  next 
three  questions  dealt  with  respondents'  familiarity  with 
mouse,  trackball,  and  touch  screen  devices.  Response  options 
ranged  from  "none"  to  "very  high." 

The  remaining  portion  of  the  questionnaire  was  aimed  at 
collecting  the  opinions  of  the  respondents  about  input  tasks, 
effort  required,  and  problems  experienced,  and  about  their 
feelings  concerning  use  of  a  touch  screen  for  their  particular 
systems.  Respondents  were  asked  to  indicate  the  percentage  of 
time  spent  on  each  kind  of  input  task,  and  whether  a  separate 
input  task  called  "target  building"  should  be  added  to  the 
usual  set  of  four  input  tasks  (listed  in  Table  1,  page  9)  . 
This  question  was  included  at  the  request  of  NTSC. 

According  to  modern  literature,  highly  accurate  cursor 
positioning  is  a  requirement  that  can  be  best  achieved  using 
the  trackball  or  mouse.  Therefore,  survey  participants  were 
asked  how  important  highly  accurate  target  or  cursor 
positioning  is  for  their  systems.  Respondents  were  given  a 


list  of  five  options  to  choose  from,  ranging  from 
"undesirable"  to  "vital",  with  one  option  being  "no  opinion." 

A  simple  "yes"  or  "no"  response  was  used  to  determine 
whether  parallax  is  a  problem  for  the  respondents'  systems. 
An  open-ended  format  was  used  to  determine  the  number  of 
minutes  before  arm  fatigue  is  experienced  by  the  respondents. 

Instructors'  and  operators'  overall  opinions  regarding  the 
use  of  touch  screens  on  their  respective  systems  were  obtained 
by  having  them  select  one  statement  (out  of  four)  that  best 
described  their  feelings.  The  first  statement  was  designed  to 
obtain  data  regarding  the  ability  of  other  input  devices  to 
perform  tasks  that  touch  screens  are  now  used  for  on  these 
flight  simulators.  The  second  and  third  statements  gave 
respondents  the  opportunity  to  indicate  frustration  stemming 
from  common  touch  screen  limitations.  The  fourth  statement 
allowed  respondents  to  indicate  strong  approval  for  touch 
screens  as  used  by  their  particular  systems. 

The  final  c[uestion  solicited  respondents'  opinions  or 
comments  on  any  topic  related  to  the  survey.  An  open-ended 
format  was  chosen  to  allow  for  maximum  flexbility,  and  to 
permit  respondents  to  elaborate  on  various  answers  in  a  single 
location  on  the  questionnaire  form. 

C.  QUESTIONNAIRE  ADMINISTRATION 

A  total  of  54  flight  training  system  instructors  and 
operators  were  surveyed.  This  is  roughly  half  of  all 
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possible  Western  United  States  flight  simulator  lOS  users. 
The  sample  was  considered  to  be  representative  of  all 
instructors  and  operators  of  military  systems  of  this  type. 
The  method  of  sampling  used  most  closely  resembles  the 
stratified  sampling  model  described  by  Denzin  [Ref.  21 :p.  73] . 
Using  this  model,  each  of  the  simulator  sites  surveyed 
represents  a  stratum. 

Instructors  are  trained  aviators,  either  active-duty  or 
retired  military.  Operators  are  trained  computer  technicians 
who  assist  the  instructors  with  system  set-up,  data  input,  and 
trouble-shooting.  When  a  student's  simulator  session  does  not 
require  the  expertise  of  an  instructor,  operators  can  conduct 
entire  training  sessions  without  the  presence  of  an 
instructor . 

Of  the  54  individuals  surveyed,  34  were  instructors  and  20 
were  operators.  All  individuals  surveyed  were  males.  The 
average  experience  level  on  the  system  for  which  the 
individuals  were  being  surveyed  was  26  months,  which  is 
representative  of  most  military  flight  simulator  instructors 
and  operators  currently  working  with  touch  screen  systems. 

The  questionnaires  were  administered  personally  at  Luke 
Air  Force  Base  and  Lemoore  Naval  Air  Station.  The 
questionnaires  for  the  simulator  sites  at  Yuma  and  El  Toro 
were  administered  by  mail.  A  detailed  cover  sheet  was 
provided  with  the  mailed  questionnaires,  and  supplemental 
assistance  was  given  by  telephone. 


IV.  DATA  ANALYSIS  AMD  RESULTS 

A.  DATA  ANALYSIS 

The  responses  to  the  lOS  touch  screen  survey 

questionnaires  were  coded,  compiled,  and  analyzed  using  the 
SPSSx  statistical  package  on  an  IBM  System  370  mainframe 
computer.  The  SPSSx  Pearson  Correlation  function  was  used  to 
compile  responses  into  a  matrix  format  and  to  obtain 

statistical  correlation  values  among  all  responses. 
Descriptive  statistics  and  cross  tabulations  were  examined  to 
determine  trends  in  the  data.  Summary  results  are  provided  in 
Appendix  B. 

A  practical  approach  was  used  for  analysis,  combining 
statistical  correlations  with  apparent  trends  in  the  survey 
findings.  This  allowed  for  a  wider  analytical  examination  of 
the  data  as  well  as  appropriate  groupings  of  data.  The 
primary  method  for  comparing  grouped  responses  was  through 
cross  tabulation. 

B.  SUMMARY  PROFILE  OF  RESPONDENTS 

1 .  Simulator  Type 

The  freq[uency  count  and  percentage  of  instructors  and 
operators  from  each  simulator  site  surveyed  are  listed  in 
Table  5.  The  table  indicates  that  there  was  balance 
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aimong  the  numbers  of  instructors,  operators,  and  simulator 
types  surveyed. 

TABLE  5.  PROPORTIONS  OF  PARTICIPANTS  USING  THE  FIVE 
SIMULATOR  TYPES. 


Simulator 

Type 

Instructors 

Operators 

Total 

Users 

Percent 

F-16C 

7 

3 

10 

18.52 

F-15E 

5 

10 

15 

27.78 

A-7E 

5 

3 

8 

14.81 

AV-8B 

5 

4 

9 

16.67 

F/A-18 

12 

0 

12 

22.22 

Total 

34 

20 

54 

100.00 

2 .  Level  of  Experience 

The  respondents'  level  of  experience  reflects  the 
number  of  months  that  the  individual  has  with  simulators  that 
use  touch  screen  technology  for  data  input .  The  average 
experience  level  was  found  to  be  26  months,  as  shown  in  Table 

6. 
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4 .  Familiarity  With  Input  Devices 


Several  questions  dealt  with  the  respondents' 
familiarity  with  mouse,  trackball,  and  touch  screen.  Most 
participants  have  some  degree  of  familiarity  with  all  three 
devices,  although  most  have  a  higher  degree  of  familiarity 
with  touch  screens. 

Tables  8,  9,  and  10  list  the  findings  for  mouse, 
trackball,  and  touch  screen  fcimiliarity .  Touch  screens  are  by 
far  the  most  familiar  input  device,  with  80%  of  the 
respondents  listing  their  familiarity  as  high  or  very  high. 
The  mouse  and  trackball  were  both  found  to  be  less  familiar 
than  touch  screen  to  the  respondents . 

Mouse  familiarity  was  listed  as  high  or  very  high  35% 
of  the  time,  while  trackball  familiarity  was  listed  as  high  or 
very  high  30%  of  the  time.  More  than  half  of  the  respondents 
listed  mouse  and  trackball  familiarity  as  low  or  medium  (54% 
and  52%  respectively) ,  while  20%  listed  touch  screen 
familiarity  as  either  low  or  medium. 
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TABLE  8. 


MOUSE  FAMILIARITY 


TABLE  9.  TRACKBALL  FAMILIARITY 


Familiarity 

Response  Frequency 

Percent 

None 

10 

18.5 

Low 

13 

24.1 

Medium 

15 

27.8 

High 

10 

18.5 

Very  high 

6 

11.1 

Total 

54 

100.0 

TABLE  10.  TOUCH  SCREEN  FAMILIARITY 


Familiarity 

"n 

Response  Frequency 

Percent 

None 

0 

0.0 

Low 

3 

5.6 

Medium 

8 

14.8 

High 

23 

42.6 

Very  high 

20 

37.0 

Total 

54 

100.0 
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C.  SUMMARY  OPINIONS  ON  THE  USE  OF  TOUCH  SCREEN 
1 .  Types  of  Tasks  Being  Performed 

Question  7  asked  respondents  to  approximate  the  amount 
of  their  overall  input  effort  that  is  expended  performing 
various  touch  screen  tasks.  The  question  made  use  of  the  four 
generic  input  tasks  set  forth  by  Foley  [Ref.  5]  in  Chapter  I 
and  one  additional  area  to  provide  for  miscellaneous 
responses,  called  "other".  Ratings  on  a  20  point  scale  from 
0%  to  100%  were  used  to  represent  the  percentage  of  the 
overall  input  effort  expended  performing  each  task.  Figures 
9  through  13  provide  histograms  from  the  SPSSx  output 
illustrating  the  response  frequencies  for  percentages  of  time 
spent  on  positioning,  selection,  text  entry,  path,  and  "other" 
tasks . 
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Figure  9.  Percentage  of  Touch  Screen  Input  Time  Spent  on 
Positioning  Tasks. 
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A  total  of  83%  of  the  respondents  claimed  that 
positioning  tasks  account  for  20%  or  less  of  their  touch 
screen  input.  More  than  half  of  these  respondents  (54%) 
claimed  that  they  do  not  use  touch  screen  for  positioning  at 
all.  The  remaining  17%  reported  that  they  use  their  touch 
screen  for  positioning  more  than  20%  of  the  time. 
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Figure  10.  Percentage  of  Touch  Screen  Input  Time  Spent 
on  Selection  Tasks. 


Selection  tasks  account  for  most  of  the  touch  screen 
input  effort  expended  by  instructors  and  operators.  A  total 
of  7  9%  of  the  respondents  reported  that  selection  tasks 
account  for  60%  or  more  of  their  overall  input  effort.  Of 
those,  63%  said  that  selection  accounts  for  00%  or  more  of  the 
input  tasks  performed. 
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Figure  11.  Percentage  of  Touch  Screen  Input  Time  Spent 
on  Text  Entry  Tasks. 


Nearly  80%  of  the  respondents  claimed  that  they  do  not 
use  a  touch  screen  for  text,  path,  or  other  tasks.  Ratings  of 
0%  were  given  for  text  entry  tasks  by  79%  of  the  respondents, 
for  path  tasks  by  88%  of  the  respondents,  and  for  "other"  by 
82%  of  the  respondents. 
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Figure  12.  Percentage  of  Touch  Screen  Input  Time  Spent 
on  Path  Tasks. 
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Figure  13.  Percentage  of  Touch  Screen  Input  Time  Spent 
on  "Other"  Tasks. 


A  cross  tabulation  relating  simulator  type  to  the 
amount  of  positioning  and  selection  being  performed  reveals 
that  83.4%  of  the  respondents  use  a  touch  screen  for 
positioning  tasks  20%  of  the  time  or  less.  Conversely,  78.9% 
use  touch  screen  for  selection  tasks  60%  of  the  time  or  more. 
Average  percentages  of  time  spent  in  these  two  tasks,  as  a 
function  of  simulator  type,  are  given  in  Table  11. 


TABLE  11.  AVERAGE  PERCENT  OF  TIME  SPENT  IN  POSITIONING  AND 
SELECTION  TASKS,  BY  SIMULATOR  TYPE. 


simulator  Type 

Percent  of  Time 

Positioning  Tasks 

Selection  Tasks 

F-16C 

36 

64 

F-15E 

0 

80 

A-7E 

8 

85 

AV-8B 

10 

73 

F/A-18 

14 

45 
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2 .  Target  Building 

Question  8  asked  for  the  instructors'  and  operators' 
opinions  regarding  whether  a  task  called  "target  building" 
should  be  added  to  the  list  of  kinds  of  tasks  performed.  NTSC 
desires  information  on  the  establishment  of  target  building  as 
a  unique  input  task,  to  be  considered  separately  during  system 
development.  Table  12  lists  the  responses  to  this  question. 
However,  these  responses  are  not  applicable  to  this  study  and 
will  not  be  discussed  further. 

TABLE  12.  RESPONDENTS'  OPINIONS  ABOUT  ESTABLISHMENT  OF 
A  SEPARATE  INPUT  TASK  CATEGORY  CALLED  "TARGET 
BUILDING" 


Opinion 

Response  Frequency 

Percent 

Yes 

14 

28.0 

No 

16 

32.0 

No  opinion 

20 

40.0 

Total 

50 

100.0 

3 .  Amoxint  of  Accuracy  Required 

Table  13  provides  a  summary  of  the  respondents' 
opinions  regarding  the  need  for  highly  accurate  target  or 
cursor  positioning  for  their  respective  systems.  Most 
respondents  (47%)  said  that  highly  accurate  target  or  cursor 
positioning  is  unnecessary  for  operating  their  simulators. 
The  next  largest  group  reported  that  this  type  of  accuracy  is 
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important  (25%) ,  followed  by  those  claiming  that  this  type  of 
accuracy  is  vital  for  system  operation  (16%) . 


TABLE  13.  RESPOHDEMTS'  ASSESSMENT  OF  THE  MEED  FOR 
HIGHLY  ACCURATE  CURSOR  POSTIOMIMG. 


Response 

Response  Frequency 

Percent 

UndesiraJole 

1 

2.0 

Unnecessary 

24 

47.0 

Important 

13 

25.5 

Vital 

8 

15.7 

No  opinion 

5 

9.8 

Group 

51 

100.0 

4 .  Parallax 

Overall,  roughly  two-thirds  (69%)  of  the  respondents 
do  not  find  parallax  to  be  a  problem  with  their  systems. 
However,  responses  were  strongly  influenced  by  the  type  of 
touch  screen  technology  used  for  the  various  systems. 

The  A-7E  and  F/A-18  both  use  capacitance  sensing  touch 
screens;  10  out  of  19  respondents  (53%)  report  that  parallax 
is  a  problem.  The  F-16C  and  the  AV-8B  both  use  optical  touch 
screens;  6  out  of  19  surveyed  (32%)  believe  parallax  is  a 
problem  with  their  system.  The  F-15E,  which  uses  resistive 
membrane  screens,  gave  totally  different  results.  None  of  the 
13  respondents  reported  that  parallax  is  a  problem  with  their 
system.  Table  14  provides  a  breakdown  of  the  responses  to 
this  question. 


TABLE  14.  IS  PARALLAX  A  PROBLEM  ? 


Simulator 

Type 

"Yes" 

"No" 

Total 

Responses 

F-16C 

(optical) 

5 

5 

10 

F-15E 

(resistive) 

0 

13 

13 

A-7E 

(capacitive) 

5 

3 

8 

AV-8B 

(optical) 

1 

8 

9 

F/A-18 

(capacitive) 

5 

6 

11 

Total 

16 

35 

51 

(percent) 

(31) 

(69) 

(100) 

5 .  Arm  Fatigue 

Another  area  explored  by  the  questionnaire  is  arm 
fatigue.  A  total  of  88%  of  the  respondents  reported  they  do 
not  experience  arm  fatigue  at  all  while  using  their  respective 
touch  screens.  Relatively  few  respondents  (6  out  of  52) 
indicated  that  arm  fatigue  was  ever  experienced.  Table  15 
lists  the  breakdown  of  answers  to  this  question,  including  the 
types  of  simulators  used  by  those  who  experience  arm  fatigue. 
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TABLE  15. 


TIME  BEFORE  ARM  FATIGUE  IS  EXPERIENCED 


Minutes  Before 
Arm  Fatigue  Is 
Experienced 

Response 

Frequency 

Percent 

simulator  Type 

10 

2 

3.9 

AV-8B,  F/A-18 

20 

1 

1.9 

AV-8B 

35 

1 

1.9 

F-16C 

40 

1 

1.9 

F-15E 

120 

1 

1.9 

F-15E 

Never 

46 

in 

« 

00 

00 

All 

Total 

. . .  --  n 

52 

100.0 

6.  Responden'ts '  Feelings  Regarding  Touch  Screen 

Nearly  one-half  (47%)  of  the  respondents  indicated 
that  they  feel  a  touch  screen  is  the  ideal  input  device,  as 
employed  by  their  respective  systems.  One-third  (33%)  feel 
that  other  devices  could  perform  better  than  or  equally  as 
well  as  touch  screen  on  their  respective  systems.  The 
general  feelings  of  the  instructors  and  operators  surveyed  are 
highlighted  in  Table  16. 


TABLE  16.  OVERALL  FEELINGS  REGARDING  USE  OF  TOUCH  SCREEN 


OPTIONS  TO  CHOOSE  FROM 

FREQUENCY 

Other  input  devices  could  perform 

better  than  or  equally  as  well  as 
touch  screen  on  a  system  like  this. 

17 

33.3 

Touch  screen  would  be  better  suited 
for  a  system  that  requires  little 
or  no  operator  expertise. 

5 

00 

Touch  screen  is  cumbersome  due  to 

dirty  screens,  parallax,  and 
inaccuracy . 

5 

00 

Touch  screen  is  the  ideal  input 
device  for  a  system  of  this  type. 

24 

47.1 

Total 

51 

100.0 

A  comparison  between  the  respondents'  simulator  type 
and  their  overall  feelings  toward, touch  screens  showed  no 
discernible  preference  for  a  particular  type  of  touch  screen 
technology.  The  majority  of  AV-8B  and  F-15E  instructors  and 
operators  (7  out  of  8,  and  12  out  of  14,  respectively)  feel 
that  a  touch  screen  is  the  ideal  input  device.  The  AV-8B 
uses  an  IR  touch  screen  while  the  F-15E  uses  resistive 
membrane . 

The  majority  of  F-16C  respondents  (7  out  of  10)  feel 
that  other  devices  could  perforin  better  than  or  equally  as 
well  as  a  touch  screen  on  their  system.  The  F-16C  touch 
screen  is  an  IR  type.  Instructors  and  operators  for  the  A-7E 
and  F/A-18  showed  no  majority  of  opinion  regarding  their 
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feelings  toward  the  use  of  touch  screen  on  their  systems. 
Both  of  these  simulators  use  capacitive-type  touch  screens. 
TedDle  17  shows  the  sub-totals,  according  to  simulator  type,  of 
responses  to  this  question. 

TABLE  17.  FEELINGS  REGARDING  USE  OF  TOUCH  SCREEN,  AS  A 
FUNCTION  OF  SIMULATOR  TYPE. 


Sim. 

Typm 

Oth*r 

Bttttttr  or 
Equal 

Raquiraa 

Littla 

Czpartiaa 

Touch  Scraan 
Cuabaraoaa 

Touch  Seraan 
Idaal 

Total 

Raaponaaa 

F-16C 

7 

1 

1 

1 

10 

F-15E 

1 

1 

0 

12 

14 

A-7E 

4 

2 

0 

2 

a 

AV-8B 

1 

0 

0 

7 

e 

F/A-ie 

4 

1 

4 

2 

11 

TOTAL 

17 

5 

24 

51 

D.  RESPONDENTS'  COMMENTS 

The  last  survey  question  gave  respondents  the  opportunity 
to  comment  on  the  systems  or  to  discuss  other  issues 
pertaining  to  the  lOS.  One-half  of  the  54  indivduals  surveyed 
provided  comments.  These  comments  are  summarized  and 
discussed  below. 

1 .  Comments  Favorable  to  Use  of  a  Touch  Screen 

Favoreible  touch  screen  comments  center  around  ease  of 
use  and  training,  efficiency  stemming  from  the  ability  to 
centralize  data  presentation,  and  convenience.  One  respondent 
writes,  "I  can't  think  of  a  better  way  to  present  multi-menu 
displays  as  efficiently  as  touch  screens."  Another  writes 
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that  inexperienced  operators  are  able  to  use  the  system  easily 
and  that  "input  can  be  structured  to  make  it  straightforward." 

2 .  Comments  Unfavorable  to  Touch  Screen  Use 

Unfavorable  attitudes  concerning  touch  screen  center 
around  technical  aspects  such  as  slowness,  parallax,  and 
overly  complex  interface  designs.  For  example,  IR  touch 
screens  require  that  the  light  beeun  is  broken  directly  over 
the  object  to  be  selected.  If  the  instructor  or  operator 
breaks  the  beam  by  touching  the  screen  at  an  angle,  there  is 
a  good  chance  of  selecting  the  wrong  object.  The  system 
interprets  the  point  of  location  to  be  different  than  what  is 
desired  or  an  additional,  unwanted  selection  is  made. 

Slow  response  time  is  also  attributed  to  certain  touch 
screen  implementations.  One  respondent  writes  that  "delays  of 
several  seconds  can  be  significant  during  certain  tactical  and 
time-critical  scenarios."  Parallax  is  seen  as  causing  the 
need  for  multiple  attempts  before  the  correct  selection 
"takes."  Menu  design  complexity  is  another  area  resulting  in 
cumbersome  operations  for  these  touch  screen  users. 

Given  the  overall  design  complexity  of  today's 
military  flight  simulators,  instructors  and  operators  must 
interface  with  massive  amounts  of  information.  When  a  touch 
screen  is  used  for  data  entry,  this  often  requires  a  large 
hierarchy  of  menu  layers.  "It  is  very  easy  to  get  lost  in 
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menus  that  are  nested  5  and  6  levels  deep,  ”  writes  one 
respondent . 

3 .  Other  Comments 

A  neutral  attitude  exists  among  the  respondents 
regarding  the  employment  of  touch  screens  on  flight  simulators 
today.  This  attitude  is  basically  a  compromise  position  which 
recognizes  the  strengths  and  weaknesses  of  touch  screens  as 
well  as  other  devices,  and  recommends  a  combination  of 
devices.  For  example,  one  instructor  claims  that  "touch 
screen  is  good  for  certain  tasks  but  data  entry  for  motion 
paths  and  target  specifics  require  other  modality."  Another 
writes,  "A  combination  of  touch  screen,  joystick,  and  keyboard 
would  work  much  better  than  any  single  system.  Quit  trying  to 
pidgeon-hole  entry  devices ! " 

E .  PERSONAL  OBSERVATIONS 

Observations  made  while  performing  this  study  provide 
additional  insight  to  the  data  obtained  from  the  survey  and 
the  literature  review.  The  simulator  sites  that  were  visited 
personally  provide  the  majority  of  these  observations. 
However,  casual  conversations  and  supplemental  information 
gathered  in  the  process  of  conducting  the  study  also  provide 
input  to  these  observations.  Since  the  designs  of  the  various 
lOS  systems  differ  widely,  each  will  be  discussed  separately. 
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1.  F-16C  Simulator  lOS 


The  F-16C  simulator  lOS  is  designed  for  all  of  the 
input  and  most  of  the  monitoring  to  be  done  through  a  single 
monitor,  using  a  highly  graphical  interface.  System 
interaction  is  centralized  in  that  the  training  scenario 
revolves  around  this  one  monitor.  Many  "pages"  of  menus  are 
needed  due  to  the  centralized  display  of  information. 

Most  of  the  F-16C  instructors  use  locally  devised 
styli  when  performing  data  entry.  These  styli  are  similar  to 
a  pencil  without  the  lead  and  facilitate  selection  accuracy  by 
making  it  easier  to  make  perpendicular  contact  with  the 
optical  screen,  as  is  necessray  to  avoid  mis-selection . 

Simplicity  of  operation  apparently  was  the  overall 
goal  for  the  design  of  this  lOS,  relative  to  others  observed. 
However,  the  implementation  actually  resulted  in  increased 
complexity.  For  example,  numeric  calculations  are  performed 
by  touching  a  menu  item  which  brings  up  a  new  page  with  an 
image  of  a  calculator  on  the  infrared  screen.  The  various 
"buttons"  pictured  on  the  calculator  are  programmed  as  menu 
items  that  are  to  be  touched,  like  any  other  menu  item. 
Moreover,  the  areas  programmed  to  sense  a  menu  selection  vary. 
Some  touch  areas  are  rather  small.  If  a  mistake  is  made,  the 
instructor  may  need  to  access  several  pages  to  correct  it. 
The  instructors  and  operators  of  this  system  appeared  to 
experience  a  higher  degree  of  dissatisfaction  and  frustration 
than  those  with  differently  designed  lOSs. 


2.  F-15E  Simulator  lOS 

The  F-15E  lOS  implementation  differs  from  the  F-16C 
lOS  in  that  touch  screen  input  is  limited  to  broad  menu 
selections  from  monitors  dedicated  solely  to  this  function. 
Additionally,  the  lOS  is  much  more  complex  to  look  at  because 
of  its  numerous  monitors  and  panels  (see  Figure  1),  but  the 
input  process  is  relatively  simple.  The  touch  screen  may  be 
used  to  select  a  general  condition,  for  example,  navigation 
training.  Specific  data,  such  as  airspeed,  are  entered  using 
a  dedicated  keypad.  Numerous  display  monitors  are  used  to 
enable  the  instructor  to  view  the  situation  without  much  need 
for  changing  what  is  being  displayed  on  the  screens. 

3 .  A-7E  Simulator  lOS 

The  A-7E  simulator  added  a  panel  of  three  capacitance¬ 
sensing  touch  screen  monitors  to  previous  versions  of  its  lOS 
several  years  ago.  These  touch  screens  are  used  only  for 
simulated  weapons  loads.  The  instructors  and  operators 
perform  input  through  a  menu-driven  interface.  Informal 
conversation  indicated  that  the  touch  screens  on  this  system 
are  unreliable,  but  hat  the  effect  of  this  unrelieUbility  is 
minimal  due  to  the  ability  to  use  a  keyboard  when  the  touch 
screen  is  down. 

4.  AV-8B  and  F/A-18  Simulator  lOSs 

The  AV-8B  (Figure  2)  and  F/A-18  lOSs  make  use  of  a 
design  methodology  similar  to  that  of  the  F-15E  lOS .  These 
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lOSs  appear  to  be  sophisticated,  as  does  the  training  being 
conducted  with  them.  However,  the  overall  result  of  dividing 
the  various  input  functions  among  several  devices  is  greater 
simplicity . 

5 .  Overall  In^lications  of  lOS  Designs 

In  general,  the  above  observations  concerning  the 
various  lOS  systems  imply  that  those  systems  designed  to  make 
prudent  use  of  touch  screens  are  enjoying  a  higher  degree  of 
satisfaction  by  the  users.  Conversely,  the  use  of  touch 
screens  for  all  kinds  of  data  entry  tasks  appears  to  increase 
the  users'  frustration  by  asking  too  much  from  the  device. 

Choice  of  an  alternative  input  device  must  be  done 
with  full  awareness  of  the  overall  flight  simulator  lOS  design 
strategy.  The  device  chosen  and  the  strategy  for  lOS  design 
can  result  either  in  satisfaction  or  frustration  for  its 
users . 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  CONCLUSIONS 

1 .  Exp«rittnce  L«vel 

The  experience  level  of  the  lOS  users  surveyed  is 
higher  than  what  is  recommended  in  the  literature  for  lOS 
users.  As  is  noted  in  Chapter  II,  researchers  suggest  that 
inexperienced  users  benefit  most  from  touch  screen  input 
methods.  The  average  experience  level  of  the  indivduals 
surveyed  is  nearly  4  years  (Tcible  6)  . 

2 .  Frequency  of  Interaction 

The  frequency  with  which  the  lOS  users  surveyed 
interact  with  their  systems  is  higher  than  what  is  recommended 
by  literature.  Touch  screens  are  recommended  for  applications 
requiring  infrequent  interaction  with  the  system  (Table  4) . 
The  vast  majority  (83%)  of  lOS  users  surveyed  interact  with 
their  systems  on  a  daily  basis  (Table  7) . 

3 .  Familiarity  With  Other  Devices 

Tables  8  and  9  indicate  that  the  lOS  users  surveyed 
are  already  familiar  with  the  mouse  and  the  trackball.  Thus, 
incorporation  of  such  input  devices  into  lOS  systems  should 
require  little  additional  training  and  minimal  problems. 
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4 .  Tasks  Being  Performed  With  Touch  Screen 


The  simulators  studied  use  touch  screens  primarily  for 
selection  tasks.  However,  survey  results  indicate  that 
instructors  and  operators  who  must  carry  out  niimerous 
positioning  tasks  feel  that  other  devices  could  perform  better 
than  or  equally  as  well  as  touch  screens  (Tables  11  and  17) . 

This  is  exemplified  by  the  F-16C  simulator  lOS,  which 
is  used  for  positioning  tasks  more  than  twice  as  much  as  any 
of  the  other  simulators  surveyed  (Table  11)  .  The  F-16C 
simulator  makes  use  of  a  highly  graphical  interface  for  all 
input  tasks,  which  may  make  the  situation  worse.  As  shown  in 
Table  4,  researchers  recommend  the  mouse  for  highly  graphical 
interfaces.  Table  17  suppports  this  recommendation  by 
indicating  that  the  F-16C  lOS  users  feel  that  other  input 
devices  could  perform  better  than  or  equally  as  well  as  touch 
screen  on  their  system. 

Survey  results  also  show  that  the  Navy,  Air  Force,  and 
Marine  Corps  are  using  touch  screens  to  perform  tasks  that  are 
not  well  suited  for  that  type  of  input  device,  yet  with 
apparent  success.  Table  1  indicates  that,  according  to  recent 
literature,  the  mouse  or  trackball  are  the  preferred  input 
devices  for  positioning  tasks.  Table  11  indicates  that 
several  of  the  Navy,  Air  Force,  and  Marine  Corps  flight 
simulators  require  users  to  perform  certain  postioning  tasks 
using  touch  screens.  However,  these  results  do  not  say  that 
other  devices  might  not  actually  be  preferred  over  touch 
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screens  for  positioning,  only  that  touch  screens  are  being 
used  with  relatively  satisfactory  outcomes. 

5 .  Degree  of  Accuracy  Required 

The  amount  of  accuracy  needed  for  target  or  cursor 
positioning  on  these  systems  does  not  seem  to  affect  the 
users'  responses  to  other  issues.  Table  13  indicates  that 
most  respondents  feel  that  such  cursor  or  target  positioning 
is  unnecessary  on  their  system. 

6 .  Parallax 

Parallax  is  a  problem  on  the  systems  surveyed  in  this 
study,  based  on  the  opinions  of  31%  of  the  respondents  (Table 
14) .  However,  this  problem  exists  primarily  with  capacitive 
and  optical  touch  screen  devices,  not  with  resistive  membrane 
systems . 

7 .  Arm  Fatigue 

Arm  fatigue  is  not  a  problem  that  can  be  associated 
with  the  simulators  surveyed  in  this  study  (Table  15) . 

8 .  Feelings  Toward  Touch  Screen 

The  majority  opinion  of  the  IDS  users  surveyed  is  that 
a  touch  screen  is  the  ideal  input  device  as  used  on  their 
systems  (Table  16)  .  These  feelings  appear  to  be 

implementation-dependent.  Table  17  indicates  that  the  F-15E 
and  the  AV-8B  lOS  users  represent  the  majority  of  those  who 
feel  that  the  touch  screen  is  the  ideal  input  device,  as 
implemented  on  their  systems. 
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Through  observation,  it  was  noticed  that  these  systems 
incorporate  similar  lOS  design  strategies.  Both  simulators 
limit  the  use  of  the  touch  screen  primarily  to  menu  selection 
(Tcible  11)  .  Further,  these  simulators  use  touch  screens  in  an 
integrated  fashion.  That  is,  other  devices  are  used  in 
concert  with  touch  screens  to  effect  system  input.  The 
implementation  of  touch  screens  on  these  systems  adheres 
closely  to  what  the  literature  suggests  as  best  uses  for  touch 
screens,  as  reported  in  Chapter  II. 

9 .  Addition  of  Mouse  or  Trackball  to  the  lOS 

Throughout  this  study,  the  ability  of  mouse  or 
trackball  to  perform  the  tasks  being  performed  via  touch 
screen  was  considered.  It  does  not  appear  that  those  systems 
that  use  touch  screens  in  a  limited  sense  (for  example,  menu 
selection)  would  benefit  from  the  addition  of  a  mouse  or 
trackball . 

However,  a  mouse  could  be  used  to  perform  some  of  the 
tasks  currently  carried  out  via  the  touch  screen  on  the  F-16C 
simulator.  There  are  two  reasons  for  this  assessment.  First, 
modern  literature  suggests  that  highly  graphical  interfaces, 
like  that  employed  by  this  simulator,  are  best  suited  for 
control  via  a  mouse.  Second,  the  F-16C  simulator  already  has 
an  optical  mouse  that  can  be  used  satisfactorily  with  the 
system.  The  mouse  is  currently  used  occasionally  by 
maintenance  operators,  but  is  not  used  for  training  sessions. 


The  F-16C  lOS  mouse  is  capable  of  performing  all  functions 
that  the  optical  touch  screen  performs. 


The  effectiveness  of  the  lOS  mouse  was  observed  to  be 
equal  to  that  of  the  touch  screen,  based  on  a  short 
demonstration  which  did  not  include  any  positioning  tasks.  If 
positioning  tasks  also  are  considered,  use  of  a  mouse  is 
expected  to  result  in  better  performance  than  use  of  a  touch 
screen . 

B .  BECOMMENDATIOMS 

1 .  Consider  Alternatives  and  lOS  Design 

The  results  of  this  study  suggest  that,  along  with  a 
touch  screen,  the  mouse  and  trackball  should  be  considered  as 
alternative  input  devices  for  flight  simulator  lOS  systems,  as 
these  systems  are  developed  and  improved.  Which  device  is 
actually  selected  must  depend  on  the  overall  system  design  and 
layout,  and  on  the  kinds  of  input  tasks  required  of  the 
instructor  and  operator.  Data  provided  in  Tables  1,  3,  and  4, 
and  throughout  Chapter  IV  can  be  used  in  determining  the  best 
general  type  of  input  device  and  the  best  implementation 
technology  for  a  given  system  and  its  required  tasks. 

The  findings  of  this  study  do  not  invalidate  the 
findings  of  other  studies.  Rather,  results  reported  here  can 
be  used  to  supplement  previous  research  findings.  The 
successful  lOS  designs  noted  in  the  study  and  the  opinions  of 
the  instructors  and  operators  of  these  simulators  strongly 
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indicate  that  matching  input  tasks  with  appropriate  input 
devices  is  critical  for  optimum  design  of  flight  simulator  lOS 
systems . 

2 .  Furhhar  Study 

Further  study  related  to  alternative  input  device 
selection  for  automated  military  training  systems  is 
recommended.  The  study  reported  here  focused  on  flight 
simulator  lOS  systems,  yet  was  necessarily  broad  in  its 
coverage  due  to  the  lack  of  existing  data  in  the  field. 
Therefore,  benefit  can  be  gained  from  focusing  on  a  particular 
aspect  of  the  data  gathered  in  this  study. 

For  example,  the  F-15E  and  AV-8B  instructors  and 
operators  appear  to  be  more  satisfied  with  touch  screens  than 
other  instructors  and  operators.  This  seems  to  be  due  to  the 
manner  in  which  these  systems  integrate  the  touch  screens  into 
their  overall  lOS  design.  Further  study  is  needed  to 
determine  precisely  what  aspects  of  integrated  lOS  design  have 
resulted  in  higher  user  satisfaction  for  these  systems. 
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APPENDIX  A 


INPUT  TASKS  AND  DEVICES  QUESTIONNAIRE 

This  questionnaire  is  designed  to  provide  the  Naval 
Training  Systems  Command  (NTSC)  in  Orlando,  Florida,  with 
vital  information  regarding  the  design  of  the 
Instructor/Operator  Station  (lOS)  in  modern  automated  training 
systems.  In  particular,  this  questionnaire  focuses  on  the  area 
of  alternative  input  devices.  The  results  will  be  used  to 
provide  guidelines  for  selecting  among  these  various 
alternatives . 

The  questionnaire  has  been  designed  by  LT  Alan  Vazquez, 
USN,  as  part  of  a  Master's  thesis.  Respondents  of  this 
questionnaire  will  be  providing  valua±>le  military-specific 
feedback  which  will  lead  to  improved  selection  guidelines  for 
the  military. 

Thank  you  for  your  valuable  time  and  knowledge. 
Questionnaire  results  and  a  copy  of  this  thesis  will  be  on 
file  at  the  Naval  Postgraduate  School,  Monterey,  CA. 

LT  Alan  A.  Vazquez 
Computer  Systems  Management 
Naval  Postgraduate  School 
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Form  No. _ 

INPUT  TASKS  AND  DEVICES  QUESTIONNAIRE 

PURPOSE :  Information  from  this  questionnaire  will  be  used  to  determine  the 
general  types  of  input  tasks  being  performed  and  the  input  devices  that 
should  be  used  for  automated  training  systems  today. 

Instructions:  Please  indicate  the  BEST  response  to  each  question.  Answers 
should  be  based  on  the  training  system  you  are  CURRENTLY  working  with. 

1.  Training  device  name  or  designation: _ 

(ex.  F-16A/C,  AV-8B,  A-7E,  etc.) 

2 .  Indicate  your  approximate  level  of  experience  on  this  system  in  years 
and/or  months:  (ex.  1  year  10  months,  etc.) 


3.  Indicate  your  frequency  of  interaction  with  the  system: 
(circle  one) 

less  than  once  per  month  at  least  once  per  month 

at  least  once  per  week  daily 

4 .  Your  familiarity  with  a  "mouse"  is  (circle  one) 

none  low  medium  high  very  high 

5.  Your  familiarity  with  a  trackball  is  (circle  one) 

none  low  medium  high  very  high 

6.  Your  familiarity  with  touch  screens  is  (circle  one) 

none  low  medium  high  very  high 
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7.  Several  categories  of  input  tasks  are  listed  below.  In  the  matrix  below, 
indicate  the  relative  proportion  of  time  you  spend  using  the  touch  screen  to 
perform  these  tasks  by  placing  an  X  in  the  appropriate  column.  If  you  do  not 
use  the  touch  screen  for  a  task  mark  the  "0%"  colvimn.  If  you  spend  ALL  your 
time  using  touch  screen  for  a  particular  task  mark  the  "100%"  column,  etc. 
Treat  each  category  separately  (do  not  worry  about  choices  adding  to  equal 
100.) 

Scunple  tasks: 

positioning  -  placement  of  the  target  or  cursor  at  a 
specific  point  on  the  screen. 

selection  -  choosing  an  item  from  a  set  of  alternatives 
(ex.  menu  selection) 

text  entry  -  specifying  a  sequence  of  symbols,  such  as 
composing  a  filename. 

path  -  similar  to  positioning  except  a  straight  or  curved 
direction  results  from  several  points. 

other  -  a  task  that  you  feel  does  not  belong  to  any 
categories  listed  above. 

Percentage  of  Input  Time  Spent 
(none)  0%  20  40  60  80  100%  (all) 


Type 

of 

Task 


If  other,  please  describe  : 


positioning 
selection 
text  entry 
path 
other 


8.  In  your  opinion,  should  an  additional  input  task  category  called  "target 
building"  be  added  to  the  list  in  Number  7  above  7  (circle  one) 

Yes  No  No  Opinion 

If  yes,  briefly  describe  what  this  task  might  consist  of  _ 


9.  For  this  system,  highly  accurate  target  or  cursor  positioning  is 
(circle  one) 

undesirable  unnecessary  i  iportant  vital  no  opinion 

10.  Is  parallax  a  problem  with  this  touch  screen  system  ? 

(circle  one) 

Yes  No 
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11.  How  long  (in  minutes)  is  it  before  arm  fatigue  sets  in  when  using  a  touch 
screen  ?  (ex.  10  mins.,  120mins.,  etc.)  If  fatigue  is  never  experienced, 
write  N/A. 


12.  Select  the  option  that  BEST  describes  your  feelings  regarding  use  of  a 
touch  screen  for  your  system:  (check  one) 

_  Other  input  devices  could  perform  better  than  or  equally  as  well  as 

touch  screen  on  a  system  like  this . 

_  Touch  screen  would  be  better  suited  for  a  system  that  requires  little  or 

no  operator  expertise. 

_  Touch  screen  is  cumbersome  due  to  dirty  screens,  parallax,  and 

inaccuracy . 

_  Touch  screen  is  the  ideal  input  device  for  a  system  of  this  type. 

13.  Use  the  space  below  to  explain  your  answer (s)  or  discuss  other 

issues  and/or  opinions  as  required: _ 


THANK  YOU  FOR  YOUR  ASSISTANCE  ! 
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APPENDIX  B 


RESULTS  OF  SURVEY 

The  results  of  the  Input  Tasks  and  Devices  Survey  are 
given  in  the  following  appendix.  Answers  to  each  question  on 
the  survey  are  given  for  individual  respondents,  allowing  for 
further  analysis.  Each  respondent's  answers  correspond  to 
each  of  the  54  "cases"  listed  in  the  left  column  of  each  page. 
All  other  columns  represent  survey  questions. 

The  column  titled  "Type  of  Simulator"  lists  the  type  of 
simulator  the  respondent  is  associated  with,  as  well  as  his 
status  as  either  an  instructor  or  operator.  The  niomber 
indicates  the  simulator  type.  An  "M"  (maintenance)  indicates 
that  the  respondent  is  an  operator  of  that  system.  An  "I" 
(instructor)  indicates  that  the  respondent  is  an  active-duty 
instructor,  which  was  not  handled  separately  from  contract 
instructor  in  this  study.  The  absence  of  a  letter  indicates 
that  the  respondent  is  a  contract  instructor  for  that  system. 

The  column  titled  "Frequency  of  Interaction"  uses  the 
symbol  ">="  to  represent  "greater  than  or  equal  to."  A  or 
"-1"  indicates  that  no  response  was  given  for  that  question. 
These  were  dealt  with  as  "missing  values"  by  SPSSx.  All  other 
responses  are  self-explanatory. 
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CASE 


TYPE  OF 
SIMULATOR 


MONTHS  OF 
EXPERIENCE 


FREQUENCY  OF 
INTERACTION 


1 

16 

22 

DAILY 

z 

16M 

96 

DAILY 

3 

16H 

24 

DAILY 

4 

16 

24 

DAILY 

5 

16 

25 

DAILY 

6 

16 

24 

>=  ONCE  PER  MEEK 

7 

16 

72 

DAILY 

8 

16 

24 

DAILY 

9 

16 

24 

DAILY 

10 

16H 

48 

DAILY 

11 

15 

12 

DAILY 

IZ 

IS 

18 

DAILY 

13 

IS 

12 

DAILY 

14 

IS 

12 

>=  ONCE  PER  MEEK 

IS 

IS 

24 

DAILY 

16 

15M 

21 

DAILY 

17 

15M 

7 

DAILY 

18 

15M 

11 

DAILY 

19 

15H 

12 

DAILY 

20 

15M 

8 

DAILY 

Z1 

15M 

18 

DAILY 

22 

15M 

21 

DAILY 

23 

15M 

60 

DAILY 

24 

15M 

22 

DAILY 

25 

15M 

13 

DAILY 

26 

71 

36 

>=  ONCE  PER  MONTH 

27 

71 

24 

>=  ONCE  PER  MONTH 

28 

711 

42 

DAILY 

29 

71 

6 

>=  ONCE  PER  MONTH 

30 

71 

6 

>=  ONCE  PER  WEEK 

31 

71 

24 

>=  ONCE  PER  MONTH 

32 

7M 

8 

DAILY 

33 

7M 

22 

DAILY 

34 

8 

72 

DAILY 

35 

8 

24 

DAILY 

36 

8 

56 

DAILY 

37 

81 

6 

>=  ONCE  PER  MONTH 

38 

8M 

12 

DAILY 

39 

8M 

14 

DAILY 

40 

8M 

31 

DAILY 

41 

8M 

36 

DAILY 

42 

8 

60 

>-  ONCE  PER  MEEK 

43 

18 

18 

DAILY 

44 

18 

14 

DAILY 

45 

18 

48 

DAILY 

46 

18 

18 

DAILY 

47 

18 

12 

DAILY 

48 

18 

3 

DAII  Y 

49 

18 

54 

DAILY 

50 

18 

16 

DAILY 

51 

18 

3 

DAILY 

52 

18 

14 

DAILY 

53 

18 

58 

DAILY 

54 

18 

18 

DAILY 

CASE 

MOUSE 

FAMILIARITY 

TRACKBALL 

FAMILIARITY 

TOUCH  SCREEN 
FAMILIARITY 

1 

NONE 

HONE 

VERY  HIGH 

2 

HIGH 

MEDIUM 

HIGH 

3 

VERY  HIGH 

HIGH 

VERY  HIGH 

4 

VERY  HIGH 

MEDIUM 

VERY  HIGH 

5 

HIGH 

MEDIUM 

VERY  HIGH 

6 

VERY  HIGH 

VERY  HIGH 

VERY  HIGH 

7 

LOW 

LOW 

HIGH 

S 

LOW 

LOW 

VERY  HIGH 

9 

MEDIUM 

MEDIUM 

VERY  HIGH 

10 

LOW 

NOME 

VERY  HIGH 

11 

MEDIUM 

MEDIUM 

HIGH 

12 

HIGH 

HIGH 

HIGH 

IJ 

HIGH 

HIGH 

HIGH 

14 

NONE 

LOW 

HIGH 

15 

MEDIUM 

MEDIUM 

HIGH 

16 

LOW 

LOW 

HIGH 

17 

LOW 

LOU 

HIGH 

18 

LOW 

VERY  HIGH 

VERY  HIGH 

19 

LOW 

LOW 

HIGH 

20 

LON 

MEDIUM 

HIGH 

21 

LOW 

NONE 

HIGH 

22 

HIGH 

LOW 

VERY  HIGH 

23 

MEDIUM 

NONE 

HIGH 

24 

VERY  HIGH 

MEDIUM 

VERY  HIGH 

25 

HIGH 

NONE 

VERY  HIGH 

26 

LOW 

LOW 

MEDIUM 

27 

MEDIUM 

MEDIUM 

HIGH 

23 

VERY  HIGH 

VERY  HIGH 

VERY  HIGH 

29 

LOW 

LOW 

MEDIUM 

30 

MEDIUM 

LOW 

MEDIUM 

31 

NONE 

NONE 

MEDIUM 

32 

NONE 

NONE 

HIGH 

33 

LOW 

NONE 

VERY  HIGH 

34 

LOW 

LOW 

VERY  HIGH 

35 

LOW 

NONE 

VERY  HIGH 

36 

HIGH 

MEDIUM 

VERY  HIGH 

37 

LOW 

LOW 

HIGH 

38 

HIGH 

HIGH 

HIGH 

39 

LOW 

HIGH 

VERY  HIGH 

40 

LOW 

HONE 

VERY  HIGH 

41 

VERY  HIGH 

MEDIUM 

VERY  HIGH 

42 

MEDIUM 

MEDIUM 

HIGH 

43 

MEDIUM 

VERY  HIGH 

MEDIUM 

44 

MEDIUM 

HIGH 

HIGH 

45 

HONE 

HIGH 

HIGH 

46 

LOW 

LOW 

MEDIUM 

47 

LOW 

MEDIUM 

LOW 

48 

HIGH 

HIGH 

HIGH 

49 

HIGH 

VERY  HIGH 

MEDIUM 

50 

HIGH 

HIGH 

MEDIUM 

51 

HIGH 

MEDIUM 

LOW 

52 

NONE 

MEDIUM 

LOW 

53 

VERY  HIGH 

VERY  HIGH 

HIGH 

54 

LOW 

HIGH 

HIGH 
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CASE 

PER  CENT 
POSITIOIIIHG 

PER  CENT 
SELECTION 

1 

80 

20 

2 

40 

60 

3 

20 

80 

A 

20 

80 

5 

20 

80 

6 

20 

7 

80 

S 

60 

100 

9 

40 

60 

10 

20 

80 

11 

0 

100 

12 

0 

100 

13 

0 

100 

19 

0 

100 

15 

100 

16 

6 

100 

17 

0 

100 

13 

0 

100 

19 

0 

80 

20 

80 

21 

6 

0 

22 

0 

40 

23 

0 

40 

29 

0 

80 

25 

80 

26 

20 

80 

27 

20 

60 

28 

0 

100 

29 

0 

60 

30 

0 

100 

31 

0 

100 

32 

0 

100 

33 

20 

80 

39 

20 

100 

35 

20 

80 

36 

0 

60 

37 

20 

100 

38 

0 

60 

39 

0 

80 

90 

100 

100 

91 

20 

20 

92 

0 

60 

93 

0 

20 

99 

60 

80 

95 

60 

40 

96 

97 

20 

98 

6 

20 

99 

0 

40 

50 

40 

80 

51 

20 

20 

52 

0 

60 

53 

0 

80 

59 

20 

80 

PER  CENT 

TEXT 

PER  CENT 
PATH 

PER  CENT 
OTHER 

0 

0 

20 

20 

6 

6 

0 

0 

0 

0 

6 

80 

20 

20 

0 

6 

0 

0 

6 

6 

6 

0 

0 

0 

0 

0 

0 

6 

6 

6 

6 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

6 

6 

0 

0 

0 

0 

0 

6 

6 

0 

0 

6 

0 

0 

0 

20 

40 

0 

0 

6 

0 

0 

0 

0 

0 

0 

20 

20 

20 

20 

0 

0 

0 

0 

40 

100 

loo 

0 

6 

0 

0 

0 

100 

0 

0 

40 

40 

0 

0 

0 

6 

0 

0 

0 

0 

6 

6 

6 

0 

0 

60 

40 

0 

0 

6 

0 

0 

0 

0 

0 

0 

0 

0 
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CASE 

TARGET 

BUILDING 

IHPORTANCE 

OF  ACCURACY 

IS  PARALLAX 
A  PROBLEM? 

1 

NO 

IMPORTANT 

YES 

2 

NO 

IMPORTANT 

NO 

3 

NO 

UNNECESSARY 

NO 

4 

NO 

important 

YES 

5 

NO 

IMPORTANT 

NO 

6 

NO 

IMPORTANT 

NO 

7 

YES 

NO 

8 

YES 

UNNECESSARY 

YES 

9 

NO 

UNNECESSARY 

YES 

10 

YES 

UNNECESSARY 

YES 

11 

YES 

UNNECESSARY 

NO 

12 

YES 

UNNECESSARY 

NO 

13 

YES 

UNNECESSARY 

NO 

14 

YES 

UNNECESSARY 

NO 

15 

YES 

UNNECESSARY 

NO 

U 

YES 

UNNECESSARY 

NO 

17 

NO 

UNNECESSARY 

NO 

18 

NO 

UNNECESSARY 

NO 

19 

NO 

UNNECESSARY 

NO 

20 

NO 

UNNECESSARY 

NO 

21 

YES 

UNNECESSARY 

NO 

22 
y  » 

YES 

IMPORTANT 

NO 

24 

NO 

UNNECESSARY 

NO 

25 

VITAL 

26 

NO  OPINION 

IMPORTANT 

YES 

27 

NO  OPINION 

UNDESIRABLE 

YES 

28 

NO  OPINION 

UNNECESSARY 

NO 

29 

HO  OPINION 

UNNECESSARY 

NO 

30 

NO  OPINION 

UNNECESSARY 

YES 

31 

NO  OPINION 

UNNECESSARY 

YES 

32 

HO  OPINION 

UNNECESSARY 

NO 

33 

NO  OPINION 

UNNECESSARY 

YES 

34 

NO  OPINION 

VITAL 

NO 

35 

NO  OPINION 

UNNECESSARY 

NO 

36 

YES 

IMPORTANT 

YES 

37 

HO  OPINION 

IMPORTANT 

NO 

38 

NO  OPINION 

IMPORTANT 

NO 

39 

NO 

IMPORTANT 

NO 

40 

HO  OPINION 

VITAL 

NO 

41 

NO  OPINION 

NO  OPINION 

NO 

42 

NO 

IMPORTANT 

NO 

43 

VITAL 

NO 

44 

YES 

UNNECESSARY 

NO 

45 

YES 

VITAL 

NO 

46 

47 

NO  OPINION 

NO  OPINION 

YES 

48 

NO  OPINION 

VITAL 

HO 

49 

HO  OPINION 

VITAL 

YES 

50 

HO 

VITAL 

YES 

51 

NO  OPINION 

HO  OPINION 

YES 

52 

NO  OPINION 

NO  OPINION 

HO 

53 

NO  OPINION 

NO  OPINION 

NO 

54 

NO 

IMPORTANT 

YES 
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CASE 


MINUTES  BEFORE 
ARM  FATIGUE 


OVERALL 

FEELINGS 


1  35 

2 


3 

4 

5 

6 

7 

-i 

8 

9 

10 

11 

12 

13 

14 

15 

40 

16 

17 

18 

19 

20 

120 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

20 

35 

36 

10 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

-i 

47 

48 

49 

50 

51 

10 

52 

53 

54 

CUMBERSOME 
OTHERS  =  OR  BETTER 
NO  EXPERTISE  REO 
OTHERS  =  OR  BETTER 
OTHERS  =  OR  BETTER 
OTHERS  =  OR  BETTER 
OTHERS  =  OR  BETTER 
OTHERS  =  OR  BETTER 
OTHERS  =  OR  BETTER 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
OTHERS  =  OR  BETTER 
TOUCH  SCREEN  IDEAL 

TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
NO  EXPERTISE  REO 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
OTHERS  '  OR  BETTER 
OTHERS  =  OR  BETTER 
TOUCH  SCREEN  IDEAL 
NO  EXPERTISE  REO 
OTHERS  =  OR  BETTER 
OTHERS  =  OR  BETTER 
TOUCH  SCREEN  IDEAL 
NO  EXPERTISE  REO 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 

TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
OTHERS  =  OR  BETTER 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 
OTHERS  =  OR  BETTER 
TOUCH  SCREEN  IDEAL 
TOUCH  SCREEN  IDEAL 

CUMBERSOME 
OTHERS  =  OR  BETTER 
CUMBERSOME 
CUMBERSOME 
CUMBERSOME 
NO  EXPERTISE  REO 
OTHERS  =  OR  BETTER 
OTHERS  =  OR  BETTER 


69 


RSFBREMCS  LIST 


1.  Naval  Training  Systems  Center,  Report  90-003,  by  Joyce 
Madden  and  Mary  Englert,  November  1989. 

2.  Telephone  conversation  between  Joyce  Madden,  Research 
Psychologist  for  the  Naval  Training  Systems  Center, 
Orlando,  FL,  and  the  author,  23  January  1990. 

3.  Pickering,  J.A.,  "Touch  Sensitive  Screens;  the 
Technologies  and  Their  Application, "  International  Journal 
of  Man-Machine  Studies,  v.25,  pp. 249-269,  September  1986. 

4.  Karat,  John,  Mcdonald,  James  E.,  and  Anderson,  Matt,  "A 
Comparison  of  Menu  Selection  Techniques:  Touch  Panel, 
Mouse,  and  Keyboard, "  International  Journal  of  Man-Machine 
Studies,  v.25,  pp.  73-78,  July  1986. 

5.  Eckhouse,  Richard,  "Alternative  Input  Devices,"  Computer. 
p.l28,  March  1988. 

6.  Rosenthal,  Steven,  "Touch  Screens:  A  Viable  Mouse 
Alternative  ?"  PC  Week,  p.90,  18  July  1988. 

7.  Foley,  J.D.,  Wallace,  V.L.,  and  Chan,  P.,  "The  Human 
Factors  of  Computer  Graphics  Interaction  Techniques,  "  IEEE 
Computer  Graphics  and  Applications,  v.  4,  pp.  13-48,  1984. 

8.  Monk,  Andrew,  Fundeunentals  of  Human-Computer  Interaction, 
pp.  108-109,  Academic  Press,  1985. 

9.  Kalb,  Ira,  "Alternatives  to  Traditional  Keyboard  Input," 
Hardcopy,  v.  7,  pp.  52-58,  May  1987. 

10.  Costlow,  Terry,  "Touch  Sensitive  Systems  Gain  Ground  for 

Data  Entry,"  Electronic  Design,  v.  32,  pp.  53-54,  26 

January  1984. 

11.  Panttaja,  Elisabeth,  "Touch  Screens  Let  Your  Fingers 
Provide  A  Fast,  Simple  Entry  Into  The  Computer," 
Electronics,  v.  57,  pp.  140-144,  19  April  1984. 

12.  Brown,  C.  Marlin,  Human-Computer  Interface  Design 
Guidelines,  pp.  134-155,  Ablex,  1989. 

13.  Lante  Corp.,  "Variety  of  Data  Entry  Devices  Make  User's 
Job  a  Snap,"  PC  Week,  p.  40,  26  January  1988. 


70 


14.  Alper,  Alan,  "Reach  Out  and  Touch,"  Computer  Systems  News, 
p.  38,  19  December  1988. 

15.  Guterman,  Jimmy,  "Putting  the  Control,  Ease  of  a  Mouse  at 
User's  Fingertips,"  PC  Week,  p.  13,  10  May  1988. 

16.  Gilmore,  Walter,  E.,  Gertman,  David,  I.,  and  Blackman, 
Harold,  S.,  User-Computer  Interface  In  Process  Control, 
pp.  211-233,  Academic  Press,  1989. 

17.  Rosch,  Winn,  L.,  "Digitizing  Teiblets  Pointing  the  Way  to 
Easier  Input, "  PC  Magazine,  v.  8,  p.  227-229,  28  November 
1989. 

18.  Dawes,  Steve,  "Are  Input  Devices  Really  A  Pest?"  DEC  User. 
p.21.  May  1989. 

19.  Rice,  Lorraine,  "Mice  vs  Trackballs:  The  Anatomy  of  a 
Choice,"  PC  Magazine,  v.  9,  p.  217,  August  1990. 

20.  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences,  Research  Product  89-20,  Questionnaire 
Construction  Manual,  by  Bettina  A.  Babbitt  and  Charles  O. 
Nystrom,  pp.  1-219,  June  1989. 

21.  Denzin,  Norman,  K.,  The  Research  Act,  p.  73,  Prentice- 
Hall,  1989. 


71 


